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1. Status of Claims 



Claims 1-29 are pending, stand rejected and are under appeal. 
A copy of the Claims 1-29 is presented in Section 8 below. 
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2. Grounds of Rejection to be Reviewed on Appeal 

Claims 1, 4, 10-12, 15, 21-23, and 26 stand rejected under 35 U.S.C. § 102(b) as being 
anticipated by U.S. Patent No. 6,31 1,150 to Ramaswamy (hereinafter Ramaswamy). 

Claims 5 and 16 stand rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Ramaswamy. 

Claims 2, 3, 6, 13, 14, 17, 24, and 25 stand rejected under 35 U.S.C. §103(a) as being 
unpatentable over Ramaswamy in view of U.S. Patent No. 4,974,191 to Amirghodsi (hereinafter 
"Amirghodsi"). 

Claims 7-9, 18-20, and 27-29 stand rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Ramaswamy in view of "A Pervasive Conservational Interface for Information 
Interaction", Eurospeech 1999, by Ramaswamy (hereinafter "Ramaswamy2"). 

Claims 1,12, and 23 are the independent claims pending in the instant application. 

Given that a dependent claim includes all the limitations of a base claim from which it 
depends and, thus, a successful argument with respect to independent Claims 1, 12, and 23 
(which have been rejected only under 35 U.S.C. § 102(b)) will obviate the rejections of the claims 
dependent tiiere from (which have been rejected under 35 U.S.C. § 102(b) and/or 35 U.S.C. 
§103(a)) s the preceding rejection under 35 U.S.C. §102(b) is presented for review in this Appeal. 

Regarding the grouping of the Claims, Claims 2-1 1 stand or fall with Claim 1, Claims 13- 
22 stand or fall with Claim 12, and Claims 24-29 stand or fall with Claim 23, due to their 
respective dependencies. 
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3. Argument 
A. Introduction 

In general, the present invention is directed to automatic clarification of commands in a 
conversational natural language vjnderstanding system (Applicants' Specification, Title). 

With respect to prior art conversational systems, page 2, line 7 to page 4, line 1 of the 
Applicants' specification discloses the following: 

Ambiguities may arise from three different sources. The first cause of 
ambiguity is that a gesture may be very general, possibly applying to several 
different aspects of the conversation. This becomes increasingly likely as more 
and more applications are operative simultaneously. Thus, if the user were to say 
"Go on to the next one" it is more than likely that several applications could 
respond to such a command. The user's intended target application was clear to 
Mm, however, and must be discovered by the conversational system without 
merely returning a question to the user requesting clarification, such as "Did you 
mean your calendar or you inbox?" Such questions quickly become annoying 
from human interlocutors and even more so from machines. 

A second cause of ambiguity is that the user naturally assumes that the 
system will be able to remember certain aspects of the conversation even when 
these pertain to different applications. For example, if the user asks "Do I have 
anything scheduled on Tuesday with Mary?" he will not be surprised if the system 
needs clarification of the type "Do you mean Mary Smith or Mary Jones?". If the 
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user then poses the request "Send a note to her saying I will be away that day" he 
will expect that the system will be able to remember that the person in question is 
the Mary referred to earlier, even though the first use of the name was within a 
calendar application and the second a mail composition application. 

A third cause of ambiguity is that all recognition systems are prone to 
occasional error. A user may speak unclearly, the environment may be noisy, or the 
user may use a word unknown to die recognition system. Further, natural language 
parsing systems incur errors of their own by their very nature: they permit the user to 
say whatever he wishes, but this freedom comes at the cost of some mistakes in 
understanding. 

Advantageously, the present principles provide methods (Claims 1 and 12) and a system 
(Claim 23) to resolve the above described ambiguities (see, e.g., Applicants' specification, p. 8, line 
10 to p. 9, line 7). 

The claims of the pending application include novel features not shown in the cited 
references and tiiat have already been pointed out to the Examiner. These features provide 
advantages over the prior art and dispense with prior art problems such as those described in die 
background section of the Applicants' specification. 

It is respectfully asserted tiiat independent Claims 1, 12, and 23 are each patentably 
distinct and non-obvious over the cited references in their own right. For example, the below- 
identified limitations of Claims 1, 12, and 23 are not shown in any of the cited references, either 
taken singly or in any combination. Moreover, these Claims are distinct from each other in that 
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they are directed to different implementations and/or include different limitations. For example, 
while Claims 1 and 12 are directed to methods, these claims include different limitations with 
respect to each other, and Claim 23 is directed to a system. Accordingly, each of Claims 1, 12, 
and 23 represent separate features/implementations of the invention that are separately novel and 
non-obvious with respect to the prior art and to the other claims. As such, Claims 1, 12, and 23 
are separately patentable and are each presented for review in this appeal. 

B. Rejection under 35 U.S.C. §102(b) over U.S. Patent No. 6,311,150 to Ramaswamy 

"A claim is anticipated only if each and every element as set forth in the claim is found, 
either expressly or inherently described, in a single prior art reference." MPEP §2131, citing 
Verdegaal Bros. v. Union Oil Co. of California, 814 F.2d 628, 631, 2 USPQ2d 1051, 1053 (Fed. 
Cir. 1987). 

The Examiner rejected Claims 1, 4, 10-12, 15, 21-23, and 26 as being anticipated by U.S. 
Patent No. 6,31 1,150 to Ramaswamy (hereinafter "Ramaswamy"). The Examiner contends that 
Ramaswamy shows all the elements recited in Claims 1, 4, 10-12, 15, 21-23, and 26. 

Ramaswamy is directed to a "metiiod and system for lrierarchical natural language 
imderstanding" (Ramaswamy, Title). In further detail, Ramaswamy discloses the following in 
Iris Abstract: 

A method for hierarchical translation of input to a formal command in 
natural language understanding systems includes presenting an input command to 
be translated to a natural language understanding engine. At least two translator 
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levels are provided in the natural language understanding engine. A first translator 

level of the at least two translator levels translates the input command into at least 

one category hy associating the input command with the at least one category for 

the next level of translators. A formal language command is output for the input 

command from a last of the at least two translator levels based on the input 

command and the at least one category. 

It will be shown herein below that the limitations of Claims 1, 12, and 23 reproduced 
herein are not shown in the cited reference, and that Claims 1, 12, and 23 should be allowed 
including the claims dependent there from as identified in Section 6 herein. 

Bl . Claims 1, 4, 10-12, 15, 21-23, and 26 

It is respectfully asserted that none of the cited references teach or suggest the following 
limitations recited in Claim I: 

identifying a winning handler for decoding a command from the utterance, 
wherein the winning handler is identified by arbitration between results provided 
by at least two of the plurality of handlers, and tire results provided at a first stage 
by at least one of the at least two of the plurality of handlers include one or more 
target utterances for the utterance. ... 

Moreover, it is respectfully asserted that none of the cited references teach or suggest the 



8 



CUSTOMER NO.: 49267 
Serial No.: 10/701,784 
Office Action Dated: March 4, 2008 

following limitations recited in Claim 12: 

arbitrating against results provided by at least two of the plurality of 
handlers to determine a winning handler for an utterance, wherein the results 
provided at a first stage by at least one of the at least two of the plurality of 
handlers include one or more target utterances for the utterance.... 

Further, it is respectfully asserted that none of the cited references teach or suggest the 
following limitations recited in Claim 23: 

a dialog manager comprising a hierarchical ordering of handlers, each 
handler being trained to be responsive to decoded utterances wherein the dialog 
manager manages arbitration between results provided by the handlers to 
determine a winning handler for an utterance and decodes the command in 
accordance with the winning handler, wherein the results provided at a first stage 
include one or more target utterances for the utterance. 

Initially, prior to reproducing the arguments submitted in the Appeal Brief, the Applicant 
will address the Examiner's comments in the Examiner's Answer . 

The Examiner has stated that the Applicants are equating each translator level in 
Ramaswamy with a stage, and thus the first translator level with a first stage (Examiner's 
Answer, p. 13). The Examiner then continued that the preceding interpretation of Ramaswamy 
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by the Applicants is not the only reasonable interpretation available (Examiner's Answer, p. 13). 
The Applicants respectfully disagree. 

First, the word " stage " is defined at pages 1384-1385 of Webster's New World 
Dictionary of the American Language, Second College Edition, David B. Guralnik, Ed. in Chief, 
1974 (hereinafter "Webster's Dictionary") as follows: "a period, level , or degree in a process of 
development, growth, or change." Hence, the words "stage" and "level" are the same, as defined 
in the preceding well known and respected dictionary source. 

Second, with respect to "arbitration" as recited at least Claims 1 and 12, the Examiner has 
stated that the Applicants' specification does not support the same (Examiner's Answer, p. 14). 
The Applicants respectfully disagree. 

For example, as disclosed at page 14, lines 11 of the Applicants' specification, one of two 
or more handlers may pose the question to another one of the two or more handlers "will you 
defer". Clearly, such an approach is not strictly score based as is Ramaswamy (highest score 
selected), but rather involves some discretion. 

While the Examiner has further argued that the preceding reproduced portion of the 
Applicants' specification cited in support of the definition of arbitration previously argued and 
also set forth herein below "is only part of disclose [sic - the disclosure] describing arbitration" 
(Examiner's Answer, p. 14), the Applicants respectfully disagree with the Examiner's position. 
For example, arbitration need not be used in every aspect from beginning to end of the 
Applicants' invention, but rather simply needs to be disclosed as being used in the first place, of 
course, in a manner that satisfies, inter alia, 35 U.S.C. 112 (which it does, with the Applicants 
respectfully noting that no rejections under the same have been asserted against the use of the 
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word "arbitration" in the claims) in order for arbitration to be claimed. Moreover, not every 
embodiment described in the specification is required to be claimed, let alone every embodiment 
or aspect thereof, in a single claim. Hence, it is respectfully asserted that the word "arbitration" 
and its ordinary meaning as defined in Webster's Dictionary as previously submitted to the 
Examiner is applicable to the pending claims and is, in fact, supported by the Applicants' 
specification as such. 

Third, as argued in further detail herein below, Ramaswamy discloses selecting a category 
(and not a winning handler as recited in Claims 1,12, and 23). While the Examiner has argued 
mat Ramaswamy allegedly discloses "If a translator error is encountered, a do nothing category is 
selected (column 2 lines 59-65). Upon output at the last translator level, the translator level 
(handler) with a do nothing output does not contribute [sic - to] the determination of a final 
formal command". However, the fact that a potential category is bypassed, leaving a previously 
assigned (from an earlier stage) category in force (e.g., the Examiner has admitted that "In 
Ramaswamy, the input command is passed to translator levels, each level flien interpreting the 
utterance and assigning it to a category", Examiner's Answer, p. 15) still does not change the fact 
that Ramaswamy selects a category (as admitted by the Examiner) and NOT a winning handler as 
recited in Claims 1, 12, and 23. 

The previous arguments from the Appeal Brief will now be reproduced for completeness. 

The Examiner has cited column 2, lines 25-65 of Ramaswamy as disclosing the preceding 
limitations recited in Claims 1 and 12. 

The Examiner has cited column 2, lines 25-65 and column 3, lines 10-20 of Ramaswamy 
as disclosing the preceding limitations recited in Claim 23. 
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The Applicants respectfully disagree with the Examiner reading of Ramaswamy. 
For example, column 2, lines 25-65 of Ramaswamy disclose the following: 

Another method for hierarchical translation of input to a formal command 
in a natural language understanding system includes the steps of presenting an 
input command to be translated to a natural language understanding engine, 
providing a plurality of translator levels in the natural language understanding 
engine, providing a pluraUty of categories for each translator level, each category 
including a group of formal language commands stored in at least one model, 
associating the input command with the categories for a given translator level, 
scoring a probability of correct translation for each of the at least two categories, 
selecting a category of the at least two categories yielding a highest score, 
associating the input command with the selected category for a next level of 
translators and outputting a formal language command for the input command 
from a last of the translator levels based on the input command and the selected 
category. 

In other methods, the step of providing a plurality of translator levels may 
include providing N translator levels where N is defined as a system parameter. 
Each category may include a subset of formal language commands to narrow a 
search space for determining the formal language command corresponding to the 
input command. The step of applying the formal language command to at least 
one application may be included. The categories may include formal language 
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command entries relevant to at least one application and may further include the 
step of applying the formal language command entries to the at least one 
application in accordance with the input command. The at least two categories 
may include all entries for the input command and may further include the step of 
associating a first portion of the entries with a given category by providing a 
formal command for each of the entries relevant for the given category. The step 
of mapping a second portion of the entries to an error command may also be 
included. The step of selecting a category of the at least two categories yielding a 
highest score may include the step of selecting a category with a lower score if a 
translation error is encountered for a category or categories yielding a higher 
score. If a translation error is encountered for all scored categories, a do nothing 
category may be selected. 

Moreover, column 3, lines 10-20 of Ramaswamy disclose the following: 

A method for building hierarchical models for translating an input 
command to a formal command in a natural language understanding system 
includes the steps of collecting training data from a domain of inputs, separating 
the training data into translation levels, the translation levels arranged to provide a 
given output at each level for associating the inputs to a category, the training 
data including the inputs and an associated formal language command for each 
input, for each translation level, indicating categories for searching for a formal 
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language command by dividing up a formal language command search space and 

associating the categories with each input and associating each input with the 

formal language command in a last translation level. 



Thus, in accordance with the limitations recited in Claims 1 and 12, "the results provided 
at a first stage by at least one of the at least two of the plurality of handlers include one or more 
target utterances for the utterance". Moreover, in accordance with the limitations of Claim 23, 
"the results provided at a first stage include one or more target utterances for the utterance". 

In contrast, Ramaswamy does not teach or suggest the preceding limitations of Claims 1, 
12, and 23, but instead involves a multi-tiered approach that, at a first stage, only outputs a target 
category for an utterance, but not a target utterance. From the target category, further stages are 
performed including in a further stage scoring a probability of a correct translation for each of at 
least two categories, in a yet further stage selecting a category yielding a highest score, in a still 
further stage associating the input command with the selected category, and in a final state 
outputting a formal language command based on the input command and the selected category 
(see, e.g., Ramaswamy, col, 2, lines 25-40). 

In fact, in prior office actions (see, e.g., Office Action dated September 25, 2007), the 
Examiner even characterized the operation of Ramaswamy in accordance with the Applicants' 
understanding thereof, explicitly stating on pages 3 and 5 of the Office Action in support of his 
rejection of Claims 1, 12, and 23 "scores for the probability of a correct translation are 
determined for at least two categories, then the category having the highest score is chosen and a 
formal command is output". 
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While the Examiner has expanded the cited portion of Ramaswamy from column 2, lines 

25-40 to now also include lines 41-60 of column 2 of Ramaswamy, the additional cited portion 

of Ramaswamy still does not disclose the above recited limitations of Claims 1, 12, and 23. For 

example, while the Examiner has pointed to Ramaswamy disclosing, inter alia, "the step of 

applying the formal language command to at least one application may be included" (Office 

Action, pp. 2-3, citing Ramaswamy, col. 2, lines 47-49), the cited portion does not overtly or 

implicitly imply that this step involves providing results at a first stage that include one or more 

target utterances for the utterance, as recited in Claims 1, 12, and 23. Moreover, while the above 

cited portion of Ramaswamy is set forth in the background section of his patent and hence is not 

detailed as the corresponding portion of the detailed description relating to the same, the portions 

of the detailed description of Ramaswamy (as argued herein) clearly show that Ramaswamy does 

not provide results at a first stage that include one or more target utterances for the utterance, as 

recited in Claims 1, 12, and 23. For example, the Examiner also cited column 5, lines 54-58 of 

Ramaswamy in the "Response to Arguments" section of the Office Action dated March 4, 2008. 

Column 5, lines 54-58 of Ramaswamy disclose "[fjranslators 102 of a hierarchical NLU of the 

present invention include categorized formal commands. Categories, and nest sub-categories, of 

the formal commands are defined and each formal command is assigned to one (or more) of 

these categories and stored in models 104". However, as described immediately there before in 

Ramaswamy, in column 5, lines 43-50: "Each translator 102 performs one portion of the 

translation process, and narrows down the search space of formal commands to be translated 

from input text 10 for the subsequent level. Level 1 translator takes in the text input 10 and 

initiates the translation process, and Level N translator concludes the translation process by 
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producing the formal command 14 associated with the text input 10 " (emphasis added). With 
respect to the cited column 5, lines 43-50 of Ramaswamy, which relate to Figure 2 of 
Ramaswarny, see also, element 208 of Figure 2 of Ramaswamy, winch discloses "associate 
inputs with each category for each level of translation" and element 210 which discloses " map 
category and input text to formal commands in each category at the last level of translation ") 
(emphasis added). 

Hence, the approach of Ramaswamy is significantly more complex in all cases, thus 
requiring more time and resources to achieve a result. In contrast, the present principles as 
represented by Claims 1, 12, and 23 provide a more efficient approach. 

Moreover, in accordance with the limitations recited in Claims 1 and 12, a winning 
handler is identified for decoding a command from an utterance by arbitration between results 
provided by at least two of the plurality of handlers. Moreover, in accordance with the 
limitations recited in Claim 23, a dialog manager manages arbitration between handlers to 
determine a winning handler for an utterance. 

In contrast, Ramaswamy does not teach or suggest the use of arbitration at all, but rather 
simply selects die category with the highest score. While the Examiner has stated that the 
Applicant's Specification does not support the definition of arbitration provided in the previous 
responses, reconsideration of the same is respectfully requested, as the portions of the 
specification explicitly supporting the definition are also included and clearly show such support. 
For example, as mentioned with respect to page 14, lines 11, one of two or more handlers may 
pose the question to another one of the two or more handlers "will you defer". Clearly, such an 
approach is not strictly score based as is Ramaswamy (highest score selected), but rather involves 
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some discretion. The following is further provided with respect to arbitration not being disclosed 
in Ramaswamy. 

As defined in Webster's New World Dictionary of the American Language, Second 
College Edition, David B. Guralnik, Ed. in Chief, 1974, p. 70, a copy of which was attached to 
the Amendment filed on December 12, 2007 in response to the Advisory Action dated November 
27, 2007 for the Examiner's convenience, arbitration refers to "the act of arbitrating; specif., the 
settlement of a dispute by a person or persons chosen to hear both sides and come to a decision". 
Also noteworthy, as defined at page 70 of the same, arbitrator refers to "1. a person selected to 
judge a dispute; arbiter, esp. one, as in collective bargaining negotiations, named with die 
consent of both sides 2. a person authorized to judge or decide", and arbitrary refers to "not fixed 
by rules but let to one's judgment or choice; discretionary". Hence, in arbitration, a person or 
thing acts as a judge to make a choice based on discretion. In contrast, Ramaswamy is not 
performing arbitration, i.e., is not using discretion, but is instead simply determining a highest 
scoring category which is hence rule-based (rule = select highest scoring category) and contrary 
to arbitration. That is, if a rule is simply to be followed (i.e., select highest scoring category) as 
disclosed in Ramaswamy, then arbitration is not even needed in the first place. 

For example, as disclosed in the Applicants' Specification, witii respect to an arbitration 
method (see, e.g., Applicants' Specification, p. 6, lines 7-8, and p. 12, line 30 to p. 13, line 2), a 
first stage of arbitration may involve posing the question "Do you understand this utterance?" to 
each handler (Applicants' Specification, p. 13, lines 7-1 1), a second state of arbitration may 
involve posing the question "Did you expect this?" to each handler that responded to the question 
posed in the first stage (Applicants' Specification, p. 13, line 19 to p. 14, line 2), and anoflier 
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state of arbitration may involve posing the question "Will you defer" to each of two or more 
handlers that still express Interest in the utterance (Applicants' Specification, p. 14, lines 11-13), 
and so forth . Hence, each of Claims 1,12, and 23 expressly recite identifying the winning 
handler by arbitration, which may involve, for example, a negotiation and so forth between the 
handlers, and not simply the application of a rule (rule = select highest scoring category) as 
disclosed in Ramaswamy. 

Moreover, while Claims 1,12, and 23 recite identifying/determining a winning handler , 
the cited portion of Ramaswamy discloses selecting a category (and not a winning handler as 
recited in these claims). As disclosed at page 8, lines 11-17 of the Applicants' Specification, a 
handler is a component of a dialog management system that interprets utterances, and not simply 
a category. 

Further, while Claims 1, 12, and 23 recite that the command is decoded in accordance 
with the winning handler identified by arbitration , the cited portion of Ramaswamy discloses 
that the category yielding the highest score is selected, the input command is associated with the 
selected category for a next level of translators, and the formal language command for the input 
command is outputted from a last of the translator levels based on the input command and the 
selected category. Hence, even assuming arguendo that Ramaswamy selected a handler (e.g., 
translator level) as opposed to a category, Ramaswamy would still not teach or suggest the 
above-recited limitations of Claims 1, 12, and 23 since Ramaswamy does not output a formal 
language command corresponding to that handler (translator level) but rather then associates the 
selected category with a next level of translators and ultimately outputs the formal language 
command from a last level of translators . 
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Accordingly, Rarnaswarny does not teach or suggest all the above-recited limitations of 
Claims 1, 12, and 23. Moreover, while not cited against Claims 1, 12, and 23, it is nonetheless 
respectfully asserted that Amirghodsi and Ramaswamy2 do not cure the deficiencies of 
Rarnaswarny, and are silent with respect to the above-recited limitations of Claims 1, 12, and 23. 

Thus, Rarnaswarny does not teach or suggest all the above-recited limitations of Claims 1, 
12, and 23. 

Accordingly, Claims 1,12, and 23 are patentably distinct and non-obvious over the cited 
reference for at least the reasons set forth above. Therefore, withdrawal of die rejection and 
allowance of Claims 1 (and, thus, also Claims 2-11), 12 (and, thus, also Claims 13-22), and 23 
(and, thus, also Claims 24-29) is earnestly requested. 
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F. Conclusion 

At least the above-identified limitations of the pending claims are not disclosed or 
suggested by the teachings of the cited combinations. Accordingly, it is respectfully requested 
that the Board reverse the rejections of Claims 1-29 as specified herein. 

In the event of any non-payment or improper payment of a required fee, die 
Commissioner is authorized to charge Deposit Account No. 50-0510 as required to correct the 
error. 



Date: i C(f A. 3o, Zo&q 

KEUSEY, TUTUNJIAN & BITETTO, P.C. 
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